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ABSTRACT 

problem solving and decision making. This report describes recent efforts in 
Southern Regional Education Board (SREB) states to increase local 
accountability for student learning, with emphasis on the 
”reward-and- sanction" programs that some states are including in their 
education accountability systems. This guidebook describes how SREB states 
are measuring and reporting progress and identifies the rewards offered for 
student achievement. Seven states (Georgia, Kentucky, Maryland, North 
Carolina, South Carolina, Tennessee, and Texas) provide financial rewards for 
raising student achievement. A detailed matrix depicts features of 
accountability programs in the SREB states of Alabama, Arkansas, Florida, 
Georgia, Kentucky, Louisiana, Maryland, Mississippi, North Carolina, 

Oklahoma, South Carolina, Tennessee, Texas, Virginia, and West Virginia. The 
guidebook also describes early outcomes of sanctions and assistance programs. 
It is recommended that educators and state leaders: (1) get tests and 

assessments right; (2) balance action with planning and evaluation; (3) make 
sure that programs are easy to understand; (4) provide help for educators to 
change; and (5) create a comprehensive accountability program. (LMI) 
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BY THE YEAR 2000— 

All states and localities will have schools with improved 
performance and productivity demonstrated by results, 

SREB Goals for Education 

Commission for Educational Quality, 1988 

If you want more money for schools, we must have more accountability for re- 
suits. . . . This message has echoed throughout schoolhouses and statehouses across 
the South in this decade. Accountability has become the ‘A’ word in education’s 
“ABCs.” 

One legislative leader explains it this way: “We knew that if we were going to vote 
for a half-cent sales tax increase and put this money into education, we needed some- 
thing to show the taxpayers the value of the dollars that were being spent.” In every 
SREB state, that “something” has been a higher standard of accountability than ever 
before. 

In most states, leaders moved responsibility for student progress closer to the 
classroom and balanced tougher state standards with more local decision making. 

With a stroke of the governor’s pen, many states stripped away the most restrictive 
rules and regulations that local educators said were road blocks to their efforts to 
improve schools. 

Ironically, this new flexibility for districts and schools has not always been wel- 
comed by local school boards, administrators and teachers. Many educators found 
themselves reluctant to shed the comfortable defense of “the state won’t let us do 
that.” But as the shift continues to more local responsibility for student achievement, 
the “culture” of schools is beginning to change. 

In 1988, when SREB asked state and regional leaders to establish educational 
goals for the year 2000, they had this to say about accountability: ‘All states and locali- 
ties will have schools with improved performance and productivity as demonstrated 
by results.” 

Every year since 1988, SREB has worked with states on this goal. SREB conferences 
and reports give legislators, their staff and education staff ways to share each state’s ex- 
periences with education accountability, including the specifics of what they are learn- 
ing about the right balance between state goals and local control. 

This report describes recent efforts in the SREB states to increase local account- 
ability for student learning, with particular emphasis on the “reward-and-sanction” 
programs some states are including in their education accountability systems. 



Mark Musick, President 
Southern Regional Education Board 
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Accountability in the 1990s: Holding Schools 
Responsible for Student Achievement 

'*We knew that we had to raise revenue for education and that meant raising taxes. 
To ask people to do that, we had to have an accountability system . '' 

State legislator 



''Business leaders had taken a very strong position that schools needed to be held 
accountable and at very high standards . '' 



State legislator 



"You have to be able to explain it — if you want the legislature to buy it. ” 

Legislative staff 



Accountability is center stage 




Accountability is not a new idea in educa- 
tion — but it has moved to center stage in the 
1990s. Today’s approaches to accountability 
build on 20 years of trial and error, as states 
searched for the best policies to promote and 
ensure student success. 

When the 1970s began, accountability in 
education focused more on whether there 
was enough classroom space and teachers, 
and whether textbooks were current. If a 
“reasonable” number of high school gradu- 
ates were going to college, the general view 
was that education was in “good enough” 
shape. If we paid attention to what we put 
into education, quality would take care of it- 
self. The shortcomings of this “inputs” ap- 
proach to accountability are apparent today. 
Many schools have enough space, enough 
teachers, current textbooks (and even 
Internet access), and they are sending most 
graduates to college and are fully accredited. 
But their students often do not meet reason- 
able expectations of achievement. 



Leaders in the SREB states began to 
expand their thinking about educational ac- 
countability in the 1980s as they shifted some 
of their attention to the skills and knowledge 
of teachers and principals. As reports from 
SREB and others monitoring education began 
to document the poor preparation of many 
teachers, states looked for ways to raise the 
standards for teaching. Most states revamped 
their licensure laws and began to require new 
teachers to pass examinations, although pass- 
ing marks in most states were set at minimal 
levels (and remain there today). States also 
developed better evaluations for both new 
and veteran teachers and principals, although 
few states provided the funds for professional 
development necessary to make the evalua- 
tions meaningful. 

States also experimented with incentive 
pay programs during the 1980s to encourage 
excellence in teaching. The plans that ulti- 
mately emerged rewarded teachers for lon- 
gevity or extra work — not student success — 



This report was prepared by Lynn M. Cornett, Vice President for State Services, and by Gale E Gaines, Associ- 
ate Director for State Services. An earlier report. Unking Education Report Cards and Local School Improvement, 
focused on the effectiveness of state school-by-school reporting requirements. 
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and most were underfunded and eventually 
abandoned. Tennessee is the SREB exception 
in that its program is still in operation and 
fully funded. 

For the most part, the failure of early in- 
centive programs can be traced to political 
and legal difficulties and the lack of will to 
spend the time and money required to give 



these programs an opportunity to work. 
While many state plans originally called for 
student achievement to play a role in the 
evaluation of teachers, no SREB state ever 
made a full-fledged effort to do so. (The best 
example of a state program that linked stu- 
dent achievement and teacher evaluation is 
the Arizona Career Ladder Plan which began 
in the 1980s and is still in place today.) 



what’s different about school accountability in the 1990s? 



Dissatisfied with the modest improve- 
ments in education indicators in the 1980s, 
and influenced perhaps by the “quality” and 
“standards” movements in business and in- 
dustry, leaders in the SREB states began to 
rethink their approaches to school account- 
ability and performance in the 1990s. 

A new policy message began to emerge, 
reflecting an era of tighter state budgets, less 
tolerance for bureaucratic controls, and 
greater emphasis on front-line authority and 
responsibility. You are responsible for im- 
proved student learning, policymakers told 
educators. Here is the standard of progress 
you must achieve and here is the flexibility 
you need to get there. 

SREB states have led the nation in devel- 
oping comprehensive school reform laws that 
carry this message to schools and classrooms. 
Most often, these programs link new aca- 
demic standards with tests and assessments 
that provide educators, policy makers and the 
public with more detailed information about 
what students are learning. Many include re- 
wards and sanctions for schools, and most 
require school-by-school reporting to parents 
and the public. 

Some states have revamped the incentive 
plans of the 1980s to fit better into a team 



approach to accountability. These programs 
focus on school improvement and reward 
entire schools when students reach achieve- 
ment benchmarks. When students in a school 
fail to meet certain benchmarks most pro- 
grams threaten sanctions. When children 
can't read or do mathematics, the message 
goes, teachers and administrators will be 
held accountable. Targeted schools are often 
given extra resources and professional assis- 
tance — but many states reserve the right to 
take over failing schools, to fire staff, and 
even to close the schools’ doors. 

What is different about 1990s-style ac- 
countability is the emphasis on local problem 
solving and decision making. Many states 
have backed away from the prescriptive rules 
and regulations of decades past. Now leaders 
are waiting to see how well local educators 
respond. Early studies suggest that many 
schools and school systems are finding the 
transition difficult. Higher academic stan- 
dards may require significant changes in the 
school curriculum, in the ways teachers 
teach, and in professional development. The 
pressure to change is likely to build resent- 
ment toward the new systems of accountabil- 
ity, and some states are likely to feel some 
political “heat” to return to some of the ways 
of the 1970s and 1980s. 
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How are states measuring and reporting progress? 

''Our system challenges schools to always improve from where they were last time. 
We are asking schools to continue to improve. ” 

Legislative staff 

"What we expect students to know and be able to do is clearer now to everyone . " 

State department of education staff 



In determining schools to receive re- 
wards or sanctions, states are using two 
approaches to accountability — sometimes 
mixing the two. Some states require schools 
to meet an absolute goal or benchmark; 
others emphasize progress, or gains in stu- 
dent achievement over time. 

Most states use gains on achievement to 
determine sanctions and rewards. States like 
Texas and North Carolina compare one year’s 
expected growth in student achievement to 
actual growth. Other states (Alabama, Arkan- 
sas, Florida, Kentucky, Maryland and Tennes- 
see) measure change in student achievement 



over two- or three-year cycles. In addition, 
Tennessee schools must meet certain drop- 
out and attendance standards or be placed 
oil probation, and probation can lead to re- 
moving a school board or superintendent or 
to reassigning staff. 

Alabama and Oklahoma use percentile 
rankings on standardized tests to set mini- 
mum goals for schools. In Oklahoma, average 
test scores in the bottom 25 percent of the 
state over a three-year period target a school 
as “high challenge.” This means schools de- 
velop improvement plans and that faculty can 
be reassigned. 



Achievement categories play a key role 




Some states are using achievement cat- 
egories to indicate how well schools are do- 
ing compared to a set of criteria. Their names 
vary: In Texas, schools are rated as exem- 
plary, recognized, acceptable or: low 
performing. Alabama uses academic clear, 
academic caution and academic alert. 
Kentucky’s plan has five categories: rewards, 
successful, not meeting threshold, in decline, 
and in crisis. Most states use student achieve- 
ment scores as the primary measure to de- 
termine how well schools are doing. The 
tests states use for these student achieve- 
ment results are ones they develop or ones 
they purchase from commercial testing 
companies. 



A few states are changing their testing 
programs to reflect a greater emphasis on 
accountability, high standards and long-term 
achievement goals. This change rarely, if ever, 
occurs without controversy and confusion. 
Parents and educators are accustomed to see- 
ing student achievement reported in relation 
to “the national average” established for com- 
mercial, norm-referenced tests. States like 
Kentucky, which uses achievement levels to 
report on student progress {e.g, novice, 
apprentice, proficient, advanced), must 
convince the public that the new reporting 
system is credible and understandable. The 
problem is compounded when results on the 
new, more challenging state tests reveal, for 
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example, that while 60 percent of the state’s 
students were “above the national average” 
on the old test, the new test finds that only 
only one-third are “proficient.” 

While one legislator acknowledges the 
difficulty in helping the public make the tran- 
sition, he believes the effort is worthwhile. 
“It’s the difference between realism and per- 
ception,” he says. “I think we have a much 
more realistic system now” 

A critical part of the accountability pack- 
age is being able to report results for every 
public school. Every SREB state has school 
district reports and all except Arkansas are 



releasing school-by-school results. Alabama 
is currently re-designing its school-level re- 
ports. Tennessee legislation also requires 
every district to report how new money is 
spent. District or school report cards in Okla- 
homa, Tennessee, Texas and West Virginia 
show how funds are spent for instruction and 
administration. 

“Owr accountability system is deal- 
ing with student achievement and the 
pressure is on for school improvement. 

We have the advantage of already hav- 
ing school and district report cards. ” 

State legislator 
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At a Glance 

Accountability Programs in SREB States 





Financial 

Rewards 


Sanctions/ 

Intervention 


School-by-School 
Report Cards 


Alabama 


— 


districts, schools 


under deveiopment 


Arkansas 


— 


districts 


no 


Florida 


districts 
encouraged 
to deveiop 


districts, schoois 


yes 


Georgia 


schoois 


— 


yes 


Kentucky 


districts, schoois 


districts, schoois 


yes 


Louisiana 


under deveiopment 


under deveiopment 


yes 


Maryland 


schools 


schools 


yes 


Mississippi 


— 


districts 


yes 


North Carolina 


schoois 


districts, schoois 


yes 


Oklahoma 


— 


schoois 


yes 


South Carolina 


schoois 


districts 


yes 


Tennessee 


schools 


districts, schoois 


yes 


Texas 


principals^ 


districts, schoois 


yes 


Virginia 


— 


— 


yes 


West Virginia 


— 


districts, schoois 


yes 



’ May be revised to a school incentive program by the 1997 legislature. 
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Rewards for student achievement 

“You can’t earn rewards by simply staying as good as you were or improving 
slightly, you have to make significant gains to earn a reward. ’’ 

State department of education staff 

'You would think that by giving millioris of dollars in rewards to schools we’d do 
nothing but make friends in those schools, but school staff became divided over what 
to do with their school’s share of the money. This happened in only a handful of cases, 
but it is an issue you hear time and again. 



Seven SREB states (Georgia, Kentucky, 
Maryland, North Carolina, South Carolina, 
Tennessee and Texas) provide financial rewards 
for raising student achievement. In addition, 
Florida encourages districts and schools to 
reward progress, but state funds are not avail- 
able. SREB states also have programs to pro- 
vide non-financial awards, such as public 
recognition. Some states work with the U.S. 
Department of Education’s Blue Ribbon 
Schools program to recognize excellence. 

With the exception of Texas, states that 
offer rewards provide these incentives to 
schools and teachers. In 1995, Texas law 
created and funded a program to reward 
principals. The program has not been imple- 
mented, and it is likely that an earlier school 



State department of education staff 

incentive program in Texas will be funded in 
place of the principal program. All school in- 
centive programs except Georgia’s set the crir 
teria for receiving rewards at the state level. 

In Georgia, schools use state guidelines to set 
their own objectives. 

The programs in Georgia, Kentucky 
North Carolina and Tennessee all provide re- 
ward money to the school and allow school 
personnel to decide how the money will be 
distributed. Kentucky also sets goals for 
school districts and allows central office staffs 
to share in the rewards program. Laws in 
Maryland and South Carolina forbid using 
reward money for individual bonuses; in 
those states, school staffs jointly decide how 
to spend the money on school improvement. 



Rewards vary widely from state to state 




The numbers of schools qualifying for 
rewards and the amounts they receive vary 
widely from state to state. In 1995, 38 percent 
of Kentucky’s schools earned rewards. In 
1997, 41 percent of Kenucky’s schools will re- 
ceive awards for improvement from 1994 to 
1996. In contrast, five percent of Tennessee’s 
schools earned rewards in 1996. In Georgia, 
where schools must apply to the rewards 



program, only 67 of 3000 schools completed 
their applications in 1994 — 10 received 
awards. In 1996, 29 schools (one percent) 
received awards. 

Funding ranges from $500,000 in Tennes- 
see to an anticipated $28 million in North 
Carolina. The first awards given in Tennessee 
provided $4,400 to each qualifying school. In 
1995 over 14,000 teachers (about 37 percent) 
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in Kentucky received bonuses of $1,300 to 
$2,600 per person depending on how high 
the performance gains were and how the 
money was distributed in the school. In the 
1996 school year, certified staff in Georgia 
schools who met performance criteria re- 
ceived $2,000 each, with total awards of $3.3 
million. The $28 million available for the first 
year of rewards in North Carolina is expected 
to provide from $500 to $1,000 per certified 
staff 

South Carolina schools qualifying for 
awards in 1996-97 received between $2,800 
and $68,400, based on $26 per student. Mary- 
land is providing $2.75 million in 1996-97; 102 
elementary and middle schools have won 
awards of $14,600 to $51,400. In Texas, fund- 
ing could provide a maximum of $5,000 per 
principal for gains in school performance, but 
no money has been awarded to date. 

Most of the reward programs, with the 
exception of the South Carolina school incen- 
tive program, have been in place only a few 
years. Early teacher response to the reward 
programs is perhaps best-documented in 
Kentucky — and is reminiscent of reactions by 
teachers to the incentive programs of the 
1980s (documented in the SREB Career Lad- 
der Clearinghouse reports, 1984-1994.) 



A study of Kentucky’s reward system by 
the University of Kentucky Institute on Edu- 
cation Reform^ documented a marked differ- 
ence in teaching philosophies between 
teachers who received awards and those who 
did not. Teachers who received rewards were 
more likely to believe that they could influ- 
ence student learning. Those who did not 
receive rewards were more likely to blame 
factors outside of school for student failure. 
Teachers at schools not receiving awards 
were also more likely to feel that schools 
cheat to get rewards and that necessary re- 
sources were not available at their school to 
implement the complete reform package. 

The study showed that only small percent- 
ages of teachers thought awards or sanctions 
were distributed fairly (16 percent of reward 
and 3 percent of non-reward teachers). 

Do rewards work? Some legislators be- 
lieve that reward programs have not had as 
much impact on school improvement as have 
threats of sanctions. Others agree with the 
legislator who says that “If we fully fund a 
rewards program, and if it is fair and teachers 
think it’s fair, then it can be more important 
than the sanctions. Our problem is getting 
enough money for rewards.” 




1 The Relationsip Between Kentucky 's Reward System and Teachers ’ Attitudes Tbwards Teaching, Learning, 
and Reform, by Peter Winograd, Eric Anderman and Traci Bliss, University of Kentucky, January 1996. 
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Hmv do sanctions and assistance programs work? 

''What we ended up doing was to put the money into the classroom — not for sala- 
ries, but for equipment, technology and smaller class sizes. We were really looking at 
trying to help students in the classroom. ” 

State legislator 

"These accountability systems need improved data management systems in the 
state department of education. ” 

State department of education staff 

"When the reform act was put into place, the department (of education) was reor^ 
ganized. One of the divisions, school improvement, is responsible for assistance to 
schools. This function got more funding, visibility and staffing. ” 

State department of education staff 



Nearly all SREB states have a sanction and 
assistance program. (The exceptions are Geor- 
gia, Louisiana and Virginia.) These programs 
rely on student achievement results to target 
troubled schools, although some states also 
consider a school system’s financial stability 
Most programs provide outside assistance for 
failing schools and districts — usually in the 
form of additional funds, expert help or 
both — and most include severe penalties for 
schools that do not improve. 

Except for Arkansas and South Carolina, 
the sanction and assistance programs in 
SREB states focus on schools rather than 
districts — although districts usually share 
responsibility for improvement. 

The process for sanctions is similar in 
most SREB states: state law or policy defines 
a “troubled,” “impaired” or “declining” 
school; schools and districts must develop 
improvement plans, usually with the assis- 
tance of “expert” educators from outside the 
district or school; most often, state depart- 
ments of education provide or coordinate 



assistance. States grant schools and districts a 
year or more to improve before further sanc- 
tions are imposed. 

The ultimate power to decide whether 
schools have met their improvement goals 
and what further sanctions, if any, are re- 
quired may reside with the chief state school 
officer (Kentucky, Maryland and Texas) or the 
state education board (Alabama, Arkansas 
and North Carolina). 

States are exercising considerable caution 
as they implement sanction programs. Both 
Kentucky and Tennessee have delayed sanc- 
tions for two years to determine if measures 
being used to identify schools are fair and 
reliable. Maryland started its program by 
identifying only a handful of schools that 
most would agree were at the lowest levels of 
student performance. Florida’s accountability 
program was developed over several years 
before legislation passed in 1996 gave the 
state board of education authority to inter- 
vene in the operation of districts that failed 
to make adequate progress. 
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A new focus for state education departments 

In response to changes in accountability 
systems, many state departments of educa- 
tion have reorganized to become more ser- 
vice oriented and less regulatory In Florida, 
for example, the professional staff of the de- 
partment of education became part of school 
assistance teams that work with schools. The 
Kentucky Department of Education coordi- 
nates the Distinguished Educator Program, 
which uses outstanding educators to provide 
direct assistance to schools “in decline.” Dis- 
tinguished educators work closely with 
school improvement teams to identify prob- 
lems, use data and information to better un- 
derstand issues, and help school staff focus 
their efforts on improving student learning. 



“The idea of distinguished educators was 
that if you have a problem, you need to use 
the very best people to help . . . and pay them 
well,” says one Kentucky legislator. The pro- 
gram can claim considerable initial success: 
all 53 schools “in decline” after the first ac- 
countability period improved with the help 
of distinguished educators. The number of 
schools eligible for special assistance (all 
schools not meeting goals) has increased in 
the most recent period, and funding is being 
sought to expand the number of distinguished 
educators. 



J 



Guides help everyone understand 
North Carolina's ABC Program 

The North Carolina ABC Program is being devel- 
oped around the three goals of strong accountability, 
an emphasis on basics and high standards, and 
providing local control for educators. After pilot 
projects of the new program in districts across the 
state, the Department of Public Instruction prepared a 
guides to help schools, parents and communities understand how the program 
will change relationships among school educators and the public. 

Written in easy-to-understand language, separate booklets were prepared for par- 
ents, teachers, principals, superintendents, local school boards and central office 
staff. The guide for parents includes tips on how parents can work with schools for 
their children's success, an explanation of the ABC Program, and a list of contacts 
for parents to call in the state department of education for information on avail- 
able reports and resources. 
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Sanctions differ from state to state 

Most state accountability systems include 
more severe sanctions for schools that fail to 
improve after completing the state’s interven- 
tion and assistance process. In some states, 
officials have the authority to fire school staff, 
move students to other schools (at the par- 
ents’ discretion), or close schools. State 
sanctions may also include forcing districts 
to consolidate with other districts, appointing 
an outside person to manage the school dis- 
trict, and removing local boards of education 
from office. 

A relatively small number of schools 
and districts have been targeted as “worst- 
performing” in most states — typically around 
5 percent. Most district “takeovers” have been 
the result of serious financial — not academic — 
problems. 

Early anecdotal evidence suggests that 
state sanctions, including the threat of firings 
and removals when schools fail to improve, 
are creating significant pressure. Even in 
states like Kentucky, where severe sanctions 
have been delayed, the eventual possibility 
of being taken over has been a motivator, 
according to legislators in the states. 

Kentucky reports that most of the 
schools targeted as being “in decline” in 
1994 appear to be making enough progress 



to remove them from being in peril of the ex- 
treme sanctions, which include transferring 
students to other schools. In Tennessee, the 
state education commissioner does not an- 
ticipate exercising the authority to take over 
school districts, but this authority is being 
used to promote school improvements. 

Some state leaders believe that the mere 
threat of sanctions is a more powerful moti- 
vator than payment of financial rewards. One 
state legislator put it this way, “We live in a 
society where people react more from the 
potential loss of their job than they do from 
making a little more money on their job.” 

Most leaders agree, however, that a bal- 
ance between rewards, assistance and sanc- 
tions is necessary to build an accountability 
system that is effective and widely percieved 
by educators and the public as fair and wor- 
thy of support. 

To date, the threat of sanctions seems 
to serve as an incentive to improve perfor- 
mance. Challenges to these sanctions and 
intervention systems will most likely occur 
when the teeth to these programs begin to 
bite — when schools are closed and teachers 
and principals no longer have jobs because 
of a school’s failure to improve student 
learning. 
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Wiat do the early studies of these programs show? 

''Unfortunately the process in our state is seen more as a sanction-producing plan 
and less as an improvement package. '' 

State department of education staff 

'We do have flaws in our accountability system, but there is also a perception of 
flaws that don't exist. ” 

State legislator 



Several states, including Kentucky, Florida 
and Tennessee, have compiled early evalua- 
tions about their education accountability 
programs. 

The Kentucky Education Reform Act of 
1990 (KERA) is one of the most closely stud- 
ied accountability systems in the United 
States. KERA and its companion assessment 
program — the Kentucky Instructional Results 
Information System (PQRIS) — have been scru- 
tinized by researchers in and out of the state. 

After examining the work of these re- 
searchers, the University of KentuckyAJniver- 
sity of Louisville Joint Center for Educational 
Policy concluded that KERA and PQRIS have 
spurred considerable changes in classroom 
instruction.^ The Center reports that: 

■ The time that elementary students spend 
writing has doubled because of open- 
ended test questions. 

■ Mathematics and science classes are in- 
cluding more hands-on and group work 
activities, especially in classes where 
mathematics portfolios are used. 

■ Almost everyone (99 percent of the prin- 
cipals, 94 percent of the teachers and 89 
percent of superintendents) thinks that 



the new assessment system has changed 
ways teachers are teaching. 

■ The system for determining rewards and 
sanctions needs to be studied (especially 
the tests and assessments used) and 
“may be difficult to defend.” 

A 1996 study by the Florida legislature’s 
Office of Program Policy Analysis and Govern- 
ment Accountability reviewed the implemen- 
tation and impact of Florida’s Blueprint 2000 
reform. Blueprint 2000 and its implementa- 
tion are overseen by the Florida Commission 
on Education Reform and Accountability, cre- 
ated by legislation in 1991. A system of school 
improvement and accountability, the law calls 
for standards, assigns the department of edu- 
cation responsibility for assisting districts and 
schools, and returns the responsibility for 
student performance to local schools, teach- 
ers and parents through school advisory 
councils that develop school improvement 
plans. 

The Florida study concluded that school 
improvement plans are becoming more fo- 
cused over time, but one-half of the plans are 
unclear in describing “how schools will evalu- 
ate the impact of improvement initiatives.” 
The report says that Blueprint 2000 has pro- 




2 What Research Tells Us About Kentucky 's New Tests by Peter Winograd and Joseph Petroko in Kentucky 
Teacher, May 1996. 
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videci schools a sense of direction and focus 
and has increased parental and community 
involvement. Also, the involvement of teach- 
ers in school improvement activities did not 
take time from teaching students. But the fact 
that many students move from one school to 
another has made it difficult to evaluate 
changes in student performance. Another 
problem is that school councils often do not 
include the required “stakeholders” (parents 
and business/community members) as mem- 
bers of the council and are often dominated 
by school employees. About one-third do not 
reflect the ethnic and racial diversity of the 
school population. 

The study recommends incentives to en- 
sure councils include all the interest groups 
required by law. It also urges more training 
for district and school staff in using data to 
develop improvement plans, and to help 
school board members understand their re- 
sponsibility to ensure that councils reflect 
communities served by the board. 

Surveys dhout Blueprmt 2000 revealed 
that teachers and principals are generally 
supportive of it. Seventy-one percent of the 
teachers and 88 percent of the principals sur- 
veyed believed that student performance has 
improved as a result of school actions imple- 
mented und^r: Blueprint 2000. However, they 
are divided about whether these actions will 
have long-term impact. 

Tennessee’s Education Improvement Act 
of 1992 provided for ongoing evaluation by 
establishing an Office of Educational Account- 
ability outside the department of education 
to monitor the implementation of reforms. 
The accountability program is based on how 
well schools are meeting performance goals: 
school attendance rates, promotion rates, 
dropout rates, and performance in the 



Tennessee Value-added Assessment, which 
relies on the results of an annual, nationally- 
normed standardized test and uses a complex 
statistical formula to measure academic gain 
of students in second through eighth grades. 
For schools meeting goals, student achieve- 
ment is expected to equal or exceed the na- 
tional academic gain. Results are reported by 
districts, schools and teachers. The “value- 
added” approach to student achievement has 
been controversial, especially the individual 
teachers’ results, since they have been re- 
leased to principals to be used as part of the 
school improvement process. 

An initial study commissioned by the of- 
fice in 1995 raised questions about the state’s 
approach to accountability and focused in 
particular on the value-added testing system. 
The report found that the complex system is 
not well understood by educators or the pub- 
lic and recommended a series of changes, 
including improving the quality of the data 
through technical changes in the tests. The 
report also identified problems in matching 
student test scores to individual teachers and 
said the system should be fine-tuned to en- 
sure that reports “reflect student achieve- 
ment gains only during the time the teacher 
is responsible for instruction.” Two of the 
three researchers recommended changes in 
using the value-added system at the class- 
room teacher level; the third recommended 
that teacher evaluation be the responsibility 
of principals alone and that the value-added 
system not be used to report on teacher 
performance. 

As a result, state leaders are discussing 
possible changes in Tennessee’s value-added 
system and in its rewards and sanctions 
program. 
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Early lessons from new school accotmtahttity programs 



Although state accountability programs 
that focus on student achievement have been 
in place for just a few years, some common 
issues are emerging. 

1. Get tests and assessments right (or you 
won't get useful results.) 

Since the new accountability programs 
rely on student achievement data to measure 
school success, the tests and assessments 
used are critical. Some states have experi- 
mented with student portfolios and group 
performance tests in an effort to gather dif- 
ferent information about student achieve- 
ment than multiple-choice tests generally 
provide. The challenges of grading these 
kinds of “authentic assessments” on a state- 
wide scale have been daunting — and some 
critics have also questioned whether the new 
assessments have overemphasized process at 
the expense of content. 

On the other hand, states that continue 
to use state-developed tests with low stan- 
dards developed in the 1980s or nationally- 
normed tests that have no standards (unless 
the “national average” is considered a stand- 
ard)may not get results that reflect the 
current thinking about what students should 
know or that challenge teachers to empha- 
size the use of knowledge and skills as well as 
“fact gathering.” These states may adopt per- 
formance standards that are too low. 

States that are expanding or redesigning 
their testing programs also face a public in- 
formation issue. New assessment programs, 
however well designed, are unlikely to 
survive unless the public understands the 
purposes for the change and finds the infor- 
mation they provide understandable and 
useful in making judgments about school 
and student performance. In particular, states 



must prepare educators, parents and the 
public when performance reporting shifts 
from “national average” comparisons on 
norm-referenced tests to descriptions of how 
well students have mastered high standards. 

''Everyone assumed the schools in the 
suburban districts were better schools 
because they were producing more 
college-bound students. Some inner city 
schools are adding more value [student 
achievement progress] in one year than 
is being added in some suburban 
schools. ” 

State legislator 

2. Balance action with planning and 
evaluation. 

While it is necessary to get programs up 
and going and to begin to “see things hap- 
pen” in a reasonable amount of time, too of- 
ten unrealistic timelines are developed. When 
appropriate tests and assessments were not 
available or under development, some states 
started programs before they were prepared 
to begin by using existing tests or combina- 
tions of old and new. These kinds of deci- 
sions, while made in an attempt to ensure 
accountability, can create confusion and 
weaken support for reform among educators 
and the public. Comprehensive outside 
evaluations — like those done in Florida, Ken- 
tucky and Tennessee — can help by spotting 
problems early on in the accountability sys- 
tem and providing information policy makers 
need to correct them. 

3. Make sure programs are easy to understand. 

An underlying theme as the accountabil- 
ity programs become established is that the 
process for determining rewards or school 
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sanctions needs to be one that can easily be 
explained to the public, parents and educa- 
tors. While there may be complex statistical 
analysis behind the system a state uses to 
measure student progress, it must be ex- 
plained in terms that can be understood by 
both the public and educators. School-by- 
school report cards should be readily avail- 
able to parents. 

''Trying to change tests is a problem. 
When most students score above the 
national average, parents are excited; 
when the new tests show they don Y do 
well, they are also excited, but in the 
opposite way. ” 

State legislator 

4. Provide help for educators to change. 

While all of the sanctions and interven- 
tion programs call for assistance to troubled 
schools, it appears that most states are not 
providing enough resources for teachers, 
principals and state department of education 
staff to learn how to do their jobs in different 
ways. The threat of sanctions may help spark 
an interest in change, but without high- 
quality professional development over a sus- 
tained period of time, educators aren’t likely 
to be able to change. 



5. Create a comprehensive accountability 
program. 

Only a third of the SREB states have 
taken a truly comprehensive approach to 
accountability in the 1990s — including stan- 
dards and higher expectations for students; 
assessments based on the standards and ex- 
pectations; rewards, assistance and sanctions; 
and school-by-school reporting to parents 
and the public. In these states, this compre- 
hensive approach to accountability — and a 
willingness to fine-tune the system as experi- 
ence dictates — increases the likelihood that 
the reforms enacted will survive and that they 
will result in permanent improvements in 
school performance. 

What is important is that the public and 
educators understand how the whole sys- 
tem — standards, assessments, rewards and 
sanctions, assistance, and reporting — ^works 
in concert to improve student learning. Of 
course, the ultimate standard against which 
these programs must be held is whether they 
produce measurable, long-term gains in stu- 
dent achievement. With enough legislative 
commitment and public support, this 
decade’s ambitious accountability efforts 
may gain the time and resources they need 
to prove their worth. 



"We feel we've learned a lot in the four years we've been on this path and we feel 
we have some very valuable information that we need to utilize to improve what we 
are doing. We have made a good start at accountability, but we know we must con- 
tinue our efforts to improve the system. " 

State legislator 
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